Mass Hierarchy Resolution in Reactor Anti-neutrino Experiments: 
Parameter Degeneracies and Detector Energy Response 
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Determination of the neutrino mass hierarchy using a reactor neutrino experiment at ~60 km 
is analyzed. Such a measurement is challenging due to the finite detector resolution, the absolute 
energy scale calibration, as well as the degeneracies caused by current experimental uncertainty of 
A77132I. The standard x 2 method is compared with a proposed Fourier transformation method. In 
addition, we show that for such a measurement to succeed, one must understand the non-linearity 
of the detector energy scale at the level of a few tenths of percent. 
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INTRODUCTION AND DEGENERACY CAUSED 
BY THE UNCERTAINTY IN Am 2 atm 

Reactor neutrino experiments play an extremely im- 
portant role in understanding the phenomenon of neu- 
trino oscillation and the measurements of neutrino mix- 
ing parameters [J. The KamLAND experiment 0] was 
the first to observe the disappearance of reactor anti- 
neutrinos. That measurement mostly constrains solar 
neutrino mixing Am^ and 612- Recently, the Daya 
Bay experiment Q established a non-zero value of #13. 
sin 2 26»i3 is determined to be 0.092 ± 0.016 (stat) ± 0.005 
(sys). The large value of sin 2 2013 is now important in- 
put to the design of next-generation neutrino oscillation 
experiments [J [B[ aimed toward determining the mass 
hierarchy (MH) and CP phase. 



It has been proposed |6j that an intermediate L^20- 
30 km baseline experiment at reactor facilities has the 
potential to determine the MH. Authors of Ref. Q and 
Ref. 0, Q studied a Fourier transformation (FT) tech- 
nique to determine the MH with a reactor experiment 
with a baseline of 50-60 km. Experimental considerations 
were discussed in detail in Ref. Q. On the other hand, 
it has also been pointed out that current experimental 
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may lead to a reduction of sensi- 
Hol . Ill I . Encouraged by the 



uncertainties in |Ar 
tivity in determining the MH 
recent discovery of large non-zero #13, we revisit the fea- 
sibility of intermediate baseline reactor experiment, and 
identify some additional challenges. 



The disappearance probability 
neutrino in a three-flavor model is: 



of electron anti- 
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In the second line of Eq. ([T]) , we rewrite the formula us- 
ing the following notations: Sy = sin6>y, Cy = cos#y, 



and using A31 
chy (NH), A31 



A 32 + A 2 i for normal mass hierar- 
A32 — A21 for inverted mass hierar- 



chy (IH) , respectively. Therefore, the effect of MH van- 
ishes at the maximum of the solar oscillation (A21 = 
7r/2), and will be large at about A21 = tt/4. Further- 
more, we can define Am 2 (i,i?) = • j; as the ef- 
fective mass-squared difference, whose value depends on 
the choice of neutrino energy E and baseline L. Since 
Am| 2 1 is only known with some uncertainties ( | Ato§ 2 | = 



(2.43 ± 0.13) x 10" 3 eF 2 [P| or more recently |Am 2 | = 
2.32t°;og x 10 _3 ey 2 [3]), there exists a degeneracy be- 
tween the phase 2 A32 + 4> in Eq. ([1]) corresponding to the 
NH and the phase 2A' 32 — (j) corresponding to the IH when 
a different |Am 2 2 | (but within the experimental uncer- 
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FIG. 1: Map of Am^ over a phase space of energy and dis- 
tance. The x-axis is the visible energy of the IBD in MeV. 
The y-axis is the distance between the reactor and detector. 
The legend of color code is shown on the right bar, which rep- 
resents the size of AmJ in eV 2 . The solid, dashed, and dotted 
lines represent three choices of detector energy resolution with 
a=2.6, 4.9, and 6.9, respectively. The purple solid line repre- 
sents the approximate boundary of degenerate mass-squared 
difference. See text for more explanations. 



tainty) is used, namely A 32 = A32 + <fr at fixed L/E 1 . In 
particular, Am|(60 km, 4 MeV) « 0.12 x 10" 3 eV r2 (us- 
ing the experimental values of Am^ and #12 [IH ), which 
is similar to the size of the experimental uncertainty of 
|Am| 2 |. Thus, at fixed L/E determination of mass hier- 
archy is not possible without improved prior knowledge 
of |Am§ 2 |. 

To some extent, this degeneracy can be overcome by 
using a range of L/E, or actually, as is the case for the 
reactor neutrinos, a range of neutrino energies Ep. Fig.[T] 
shows the magnitude of AmJ as a function of distance 
between reactor and detector (L in km) and the visi- 
ble energy of the prompt events of inverse beta decay 
(IBD), which is related to the incident neutrino energy 
(E V i S sa Ei, — 0.8 in MeV). It is seen that for the region 
with baseline L below 20 km, the effective mas-squared 
difference Ato^ remains almost constant for the entire 
IBD energy range. That indicates an irresolvable degen- 
eracy across the entire spectrum of IBD given the current 
experimental uncertainty of |Am| 2 |- At larger distances, 
w 60 km, Am? exhibits some dependence on energy, in- 
dicating that the degeneracy could be possibly overcome, 
as discussed further below. 

With a finite detector resolution, the high frequency os- 
cillatory behavior of the positron spectrum, whose phase 



contains the MH information, will be smeared out, par- 
ticularly at lower energies. For example, at 60 km and 4 
MeV, 2A 32 « 30tt for |Am§ 2 | = 2.43 x 10~ 3 eV 2 . There- 
fore, a small variation of neutrino energy would lead to 
a large change of 2A32. 



We modeled the energy resolution as: 




y/E (MeV) ' 



1%, 



(3) 



with choices of a = 2.6, 4.9, and 6.9. The values of 4.9%, 
and 6.9% are chosen to mimic achieved energy resolutions 
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The 



1 Other degenerate solutions, naturally, might exist when the un- 
certainty in A32 is larger than 2ir. 



of current state-of-art neutrino detectors Borexino 
(5-6%) and KamLAND (~ 7%), respectively, 
value of 2.6% corresponds to an estimated performance 
for ideal 100% photon coverage. Our simulation suggests 
that the lines defined by the relations 2 A32 ^ = 0.68 x 27r 
represent boundaries of the region where the high fre- 
quency oscillatory behavior of the positron spectrum is 
completely suppressed. The solid, dashed, and dotted- 
dashed lines in Fig. [T] show these boundaries for a = 2.6, 
4.9, and 6.9, respectively. The left side of these lines 
(lower values of E v i s ) will yield negligible contributions 
to the differentiation of MH. 

As pointed out above, when Am^ becomes essen- 
tially independent of E vis , the degeneracy related to the 
|Am| 2 | uncertainty makes determination of MH impossi- 
ble. Again, our simulation suggests that the dividing line 
is Am? = 0.128 x 10~ 3 eV 2 , indicated by the purple line 
in Fig.[T] The right side of this line (larger values of E vis ) 
alone will play very small role in differentiating between 
these two degenerate solutions. Thus, the region between 
the steep lines related to the energy resolution and the 
purple diagonal line related to the degeneracy is essen- 
tial in extracting the information of the MH. Therefore, 
at L < 30 km it is impossible to resolve the MH while at 
L w 60 km there is a range of energies where the affect of 
MH could be, in principle, visible. At such a distance, the 
'solar' suppression of the reactor v e flux is near its maxi- 
mum and thus the higher frequency and lower amplitude 
'atmospheric' oscillations become more easily identified. 

In order to explore the sensitivity of a potential mea- 
surement and simplify our discussion, we assume a 40 
GW thermal power of a reactor complex and a 20 kT de- 
tector. In the absence of oscillations, the event rate per 
year at 1 km distance, R, is estimated using the results 
of the Daya Bay experiment 0] to be R = 2.5 x 10 8 /year. 
At a baseline distance of L, the total number of events N 
is then expected to be N = R-T (year) /L(km) 2 xP(i7 e — » 
i7 e ), where P(i7 e — > i7 e ) is the average neutrino survival 
probability. Values of mixing angles and mass-squared 
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FIG. 2: Top panels show the comparison of IBD energy spectrum (no statistical fluctuations) w.r.t. E V i S in (MeV) for fixed 
lAm 2 ^! = 2.43 x 10 -3 eV 2 (ideal spectrum in top left), for degenerate |Am3 2 | (ideal spectrum in top middle), and degenerate 
|Am3 2 | with 100 kT ■ year exposure (realistic spectrum in NH case and ideal spectrum in IH case in top right). The ideal 
spectrum represents the case without any statistical fluctuations, while realistic spectrum include these statistical fluctuations. 
The resolution parameter a is chosen to be 2.6. Bottom panels show the ratio of NH to IH case. Due to statistical fluctuations, 
the range of Y axis in bottom right panel is enlarged to 0.7-1.3 from 0.85-1.15. 



differences used in the simulation are taken from [3j, Il2j : 

sin 2 26»i2 = 0.8611^22 

Amai = (7.59 ± 0.21) x HT 5 ^ 2 

sin 2 2f5 23 ~ 1 

|Am^ 2 | = (2.43 ± 0.13) x 10 _3 eT/ 2 

sin 2 26>i 3 = 0.092 ± 0.017 (Daya Bay) (4) 

For example, with 5 years running at 60 km, the total 
number of events is about 10 5 . In addition, we assume 
a = 2.6 in Eq. ([3]). The reactor anti-neutrino spectrum 
was taken from Ref. [3. The fuel fractions of U 235 , U 238 , 
Pu 239 , and Pu 241 arc assumed to be 64%, 8%, 25%, and 
3%, respectively. 

Fig. [5] shows the comparison of the IBD energy spec- 
trum (top panels) and the ratio of NH to IH spectrum 
(bottom panels) w.r.t. E V i S k, — 0.8 in MeV. It is im- 
portant to note that we assumed a perfect absolute en- 
ergy calibration and knowledge of reactor IBD spectrum. 
Also, the ideal spectrum without statistical fluctuations 



is considered in the left and middle panels. Compared 
with the case at known |Am| 2 | with no uncertainty (left 
panels in Fig. [2J , the difference between NH and IH can 
be considerably reduced due to the lack of precise knowl- 
edge of |Am| 2 | (middle panels in Fig. [2]). Furthermore, 
in right panels of Fig. we show the realistic spectrum 
of NH with statistical fluctuations at 100 kT ■ year ex- 
posure together with the ideal spectrum for the IH case. 
The ratio of these two spectra is shown in the bottom 
right panel. 



In this section we have therefore identified the ambigu- 
ities associated with the uncertainty of the |Am 2 2 | value 
in relation to the finite detector energy resolution. In 
particular, we have shown that, under rather ideal con- 
ditions (perfect energy calibration, very long exposure, 
etc.), the corresponding degeneracies can be overcome at 
intermediate distances (~ 60 km) and in a limited range 
of energies. 



4 



0.04 
0.03 
0.02 
0.01 




-NH 
IH 



■50 



50 



AX 2 



FIG. 3: The A\ 2 spectrum from Monte Carlo simulation. 
The NH (IH) represents the case when the nature is normal 
(inverted) hierarchy. 



nature is NH (IH), which can be directly determined from 
Fig. |3l Finally, the average probability can be calculated 
by evaluating the weighted average based on the A% 2 dis- 
tribution in Fig. |3] assuming the truth is NH. The average 
probability is determined to be 98.9% with 100 kT ■ year 
exposure with resolution parameter a = 2.6. Since this 
average probability is obtained by assuming a perfect 
knowledge of neutrino spectrum as well as the energy 
scale, it represents the best estimate for the separation 
of mass hierarchy. 

In order to relax the requirement of knowledge 
on energy scale and energy spectrum, an attractive 
Fourier transform (FT) method was proposed recently in 
Refs. 0-0. In particular, in [U the quantity (RL + PV) 
is introduced 



RV - LV P - V 

RL = — — PV = 



RV + LV 



P + V 



(7) 



EXTRACTION OF THE MASS HIERARCHY 

In order to study the sensitivity of the mass hierar- 
chy determination under these conditions, we use the x 2 
method together with Monte-Carlo simulations to com- 
pare the simulated IBD energy spectrum of 100 kT -year 
exposure with the expected spectrum in both NH and IH 
cases. The procedure is as follows. First, the simulated 
spectrum was fit assuming NH by minimizing 



Xnh 



E 



(S^ - Sj m (Am 2 )) : 



+ X 2 (Am 2 ) (5) 



with respect to Am 2 . Here, (SI NH ) is the mea- 
sured spectrum (the expected spectrum with NH which 
depends on value of Am 2 ) at the ith bin. The SS^ 
is the statistical uncertainty in the ith bin. The last 
term in Eq. ([5]) is the penalty term from the most recent 
constrains of |Ato§ 2 | of MINOS (|Am 2 | = 2.32±°;J 2 x 
l0~ 3 eV 2 [HI). The value of Ato 2 at the minimum \ 2 
is defined as Am 2 lin NH . Second, the fit was repeat as- 
suming IH to obtain xjn anc ^ Am min ih- Third, the 
difference in chi-square values (Ax 2 ) is defined as: 



A X 2 = xW Am Ln nh) ~ X 2 m( Am l 



IH) 



(6) 



The distributions of A% 2 for the true NH (black solid 
line) or IH (dotted red line) are shown in Fig. |3l The 
area under each histogram is normalized to unity. Fur- 
thermore, since the true value of |Am 2 2 | is not known, 
the value of |Am| 2 | used in the simulated spectrum is 
randomly generated according to the the most recent 
constrains of |Am 2 2 | from MINOS. Fourth, given a mea- 
surement with a particular value of Ax 2 , the probability 
of the MH being NH case can be calculated as D Pn , h „ — . 

. . . fNH+flH 

The Pnh {Pih) is the probability density assuming the 



where P is the peak amplitude and V is the amplitude 
of the valley in the Fourier sine transform (FST) spec- 
trum. There should be two peaks in the FST spectrum, 
corresponding to A 32 and A 31 , and the labels RAL) re- 
fer to the right (left) peak. Simulations in Ref.[9j show 
that the signs of RL and PV are related to the hierarchy; 
positive for NH and negative for IH. In addition, in [9j 
it was argued that value of RL + PV is not sensitive to 
the detailed structure of the reactor IBD spectrum nor 
to the absolute energy calibration. 

In Fig. |4j we plot the central values of (PV + RL) for 
a range of |Am 2 9 1 and for both hierarchies with the pre - 
2011 flux [16l - l20j and the new re-evaluated flux [20h22| . 
Although the general feature of (PV + RL) (positive for 
NH and negative for IH) is confirmed, the |Am 2 2 | de- 
pendence of (PV + RL) value is shown to depend on the 
choices of flux model. In addition, as we emphasized in 
Fig. [T] when trying to determine the MH, one should not 
use just one fixed value of |Ato| 2 | for comparison of the 
NH case with the IH case (as was done in Refs. (1,0) but 
consider all possible values of |Am| 2 | within the current 
experimental uncertainties. The observed oscillation be- 
havior with prc-2011 flux would lead to a reduction in the 
probability to determine the MH. With the Monte-Carlo 
simulation procedure using (PV + RL) , the average prob- 
ability is determined to be 93% with the pre-2011 flux. 
Furthermore, the average probability is expected to be 
smaller than that from the full \ 2 method in general, 
since the FT method utilizes less information (e.g. only 
heights of peaks and valleys) in order to reduce the re- 
quirement in energy scale determination. Fig. |4] shows 
that a good knowledge of the neutrino flux spectrum is 
desired to correctly evaluate the probability of MH de- 
termination with the FT method. 
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served spectrum due to the finite detector energy resolu- 
tion, while the upper limit is caused by the degeneracy, 
i.e. by the fact that Am^ becomes almost independent 
of energy from that value on. All of these are then re- 
flected in the FT analysis. Although the FT method docs 
not require an absolute calibration of energy scale Q , a 
precision calibration of the relative energy scale is ex- 
tremely important. A small non-linearity of the energy 
scale characterization can lead to a substantial reduction 
of the discovery potential. 

To illustrate this point, wc consider the case corre- 
sponding to IH, and assume that (due to imperfect under- 
standing of the detector performance) the reconstructed 
energy E rec is related to the real energy E rea i by the 
relation 



FIG. 4: Values of (RL + PV) for a range of | Am| 2 1 and both 
hierarchies are plotted for the 100 kT ■ year exposure with 
both pre-2011 flux and the re-evaluated flux. 
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CHALLENGES OF THE ENERGY SCALE 

As stressed in the discussion of Fig. [TJ in the energy 
interval E V i S = 2 — 4 MeV (at L — 60 km) the quan- 
tity Am| changes significantly with respect to the un- 
certainty in IA77132I 2 . The lower limit of that region is 
caused by the smearing of the fast oscillations of the ob- 



(Here we use the notation |A'm3 2 | and |Am3 2 | to empha- 
size the fact that |Ato| 2 | is known only within a certain 
error.) If the energy scale is distorted according to this 
relation, and that distortion is not included in the way 
the reconstructed energy is derived from the data, the 
pattern of the disappearance probability regarding the 
atmospheric term will be exactly the same as in the NH 
case. This can be seen as: 



J 



cos (2|Am^ 2 | - Am£(£ P) L)) 



E, 



cos (2|A'm| 2 |+Am|(E 5 ,L)) 



L 



(9) 



r 



from Eq. ([TJ. In this case the analysis of the spectrum 
would lead to an obviously wrong MH. Since the exact 
value of |Am3 2 | is not known, we must consider in Eq. ([5]) 
all allowed values of |A'm3 2 | including those that mini- 
mize the ratio E rec / E rea i. 



Fig. [5] shows the ratio E rec / E rea i versus the visible 
energy (solid line) with the energy scale distortion de- 
scribed by Eq. where |A'to§ 2 | was chosen so that this 
ratio is one at high E V i S . Comparing the medium en- 
ergy region (2 MeV < E vis < 4 MeV) with the higher 
energy region (E vis > 4 MeV), the average E rec /E rea i 
is larger than unity by only about 1%. In addition, the 
same argument similar to Eq. ([8]) applies to the NH case 
as well. The ratio E rec /E rea i versus the visible energy 
(dotted line) of NH is also shown in Fig. [5] Therefore, 
to ensure the MH's discovery potential from such an ex- 
periment, the non-linearity of energy scale (E rec / E rea i) 
needs to be controlled to a fraction of 1% in a wide range 
of E v i s . This requirement should be compared with the 



current state-of-art 1.9% energy scale uncertainty from 
KamLAND [23|. Therefore, nearly an order of magni- 
tude improvement in the energy scale determination is 
required for such a measurement to succeed. 



UNCERTAINTIES IN 



The current primary method to constrain |Am| 2 | is 
the disappearance experiment. However, similar to 
the v e disappearance case as in Eq. [TJ the disappear- 
ance measurement in vacuum 2 would also measure an 
effective mass-squared difference rather than |Am| 2 | di- 



2 In practice, the uncertainty in the matter effect would introduce 
only a systematic uncertainty. The strength of the effect in 
disappearance is close to that of changing | Am 2 2 1 by a few times 
of 10- 6 eV 2 . 
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FIG. 5: The ratio of E rec to E rea i for the case of IH based 
on Eq. © (solid line) is shown w.r.t the visible energy E v i s . 
The dotted line shows the ratio of E rec to E rea i for the case 
of NH. 



FIG. 6: The dependence of effective mass-squared difference 
Am^ (solid line) and Am^ (dotted line) w.r.t. the value of 
Sep for v e and disappearance measurements, respectively. 



rectly. The corresponding effective mass-squared differ- 
ence is smaller than that in the v e case, basically since 
in the Eq. © the cosine squared of #12 is replaced by 
the sine squared. Also, in this case, the effective mass- 
squared difference will depend not only on A21, #12, but 
also on 0i3, 023, as well as on the unknown CP viola- 
tion phase 5c p- The effective mass-squared differences 
from and v e disappearance w.r.t. the value of 6cp are 
shown in Fig. [5] The difference in AmJ between the 
and v & channels actually opens a new path to determine 
the MH. This possibility was discussed earlier in Refs. 
[24, 25 1 . It was stressed there that the difference in fre- 
quency shifts 2A32 ± </> has opposite signs for the v e and 
;/ M disappearance in the normal or inverted hierarchies. 
Such a measurement would require that 2A32 ± (f> is mea- 

-5 cT /2 



sured to a fraction of Am^^ 
in both channels. In the current 



Am ;U 



level(5xlCr 5 eV 2 ) 
60 km configuration, 
enters through the penalty term 



the knowledge of |Ato§ 2 | 
in Eq. (JSJ) - Therefore, in order for knowledge of jAm^l 
to have a significant impact to the determination of MH, 
the A32 ± <p in channel should also be measured to a 
fraction of Am 2 e< ^ — Am^ level, which is well beyond 



the reach of current generation 
surements. 



disappearance mea- 



CONCLUSIONS 

In summary, the sensitivity of determining the neu- 
trino mass hierarchy using the reactor neutrino experi- 
ment at ^60 km is explored and its challenges are dis- 
cussed. Such a measurement is difficult due to the fi- 
nite detector energy resolution, to the necessity of the 
accurate absolute energy scale calibration, and to degen- 



eracies related to the current experimental uncertainty 
of |Am3 2 |. The key to the success of such a measure- 
ment is to control the systematic uncertainties. We show 
here that one must understand the non-linearity of the 
detector energy scale to a few tenths of percent, which 
requires nearly an order of magnitude of improvement 
in the energy scale compared to the current state-of-art 
limit, 1.9% from KamLAND. 
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